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ANALYTIC FUNCTION MODELS OF NOISE AND MODULATION 


By John H. Painter, Someshwar C. Gupta, 
and Jon W. Bayless 

SUMMARY 

This paper is essentially a presentation of the theory of complex analytic time 
functions applied to a representation of stochastic and deterministic time processes. By 
using analytic notation, noise and modulated signals are represented in the same manner. 
An intuitively satisfying, yet mathematically rigorous, method of transition from real to 
analytic processes is given. By use of the theory of distributions, the rotating vector, 
or phasor, method is generalized to arbitrary functions and stochastic processes. The 
advantages of analytic time function notation are exploited to derive correlation and spec- 
tral functions for both signal and noise processes. The polar and quadrature forms for 
band-pass processes are derived. 


INTRODUCTION 

The purpose of this paper is to present, in a comprehensible, yet reasonably rigor- 
ous manner, the fundamentals of a method of analysis whereby stochastic processes 
(noise) and signals are treated with the use of a common notation; that is, a notation is 
presented which allows the writing down of signal and noise expressions in the same form. 
This procedure eases the examination of those common characteristics of signals and 
noise which are of interest, such as correlation and spectral functions. The notational 
concept presented is that of expressing real signal and noise processes as analytic time 
functions or processes. Here, the word analytic is used in the sense of the theory of 
complex variables. 

This analytic concept has existed for approximately 20 years. However, documenta- 
tion is fragmentary and scattered. Also, a method of transition from real to analytic 
processes which is intuitionally satisfying and mathematically rigorous is thought, by the 
authors, to be lacking. This paper is written to remedy both of these difficulties. 

The paper starts with a generalization of the rotating -vector method for steady- 
state analysis of linear time -invariant systems. Next, the analytic form of a real deter- 
ministic time function along with the Hilbert transform relations is developed. Then, the 
transition from deterministic functions to stochastic processes is made. A linear trans- 
form of the convolution type is introduced as a method of generating analytic functions 



or processes from their real parts. With the use of this transform, the correlation 
and spectral relations between real and analytic counterparts are developed. 

The second part of the paper emphasizes band-pass processes; band-pass noise 
and modulated carriers are special cases of these processes. The quadrature form of 
a band-pass process is presented and its analytic counterpart is derived. Stationarity 
conditions are examined in detail. The text of the paper concludes with the develop- 
ment of the polar form of a band-pass process, which is particularly suited for repre- 
sentation of modulated carriers. 

Three appendixes are given which serve to derive rigorously certain results needed 
in the text. Appendix A gives insight into the relationship between the Hilbert transform 
and analytic time functions. Appendix B covering correlation properties of complex 
stochastic processes is given for completeness. Appendix C contains some original 
results from distribution theory. 

SYMBOLS AND NOTATION 

This section defines the symbols and mathematical notation used in the body of 
the paper. Symbols for the appendixes are not listed here. Since the appendixes are 
short and self-contained, each new symbol is defined within each appendix. 

Subscripting, as applied to functions, is standard. Thus, the symbol Qxy( ) means 
the function Q( ) which is related to functions x( ) and y( ). General mathematical 
notation and functions are standard except as detailed below. 

Mathematical notation: 

statistical expectation operator 

Fourier transform correspondence 

equality by definition 

denotes Hilbert transform 

midline asterisk denotes convolution; superscript asterisk denotes complex 
conjugate 


e{> 

A 


i -fl 


2 


Re( ) real part of variable 


1 

I 

f 

i 

Real numbers: 

A amplitude constant, dimensionless 

t, t independent time variables, seconds 

a constant, dimensionless 

< p phase constant, radians 

v dummy variable of integration 

a>,o) c frequency variables, radians per second 

Deterministic functions and stochastic processes: 

h( ) complex deterministic network impulse response function 

m( ) complex low-pass modulation function (deterministic or stochastic, 
depending on context) 

n( ) real band-pass stochastic noise process 
nj( ) real low-pass stochastic noise process 

s( ) real band-pass signal function (deterministic or stochastic, depending on 
context) 

x ( ),y( ) real low-pass noise functions (deterministic or stochastic, depending 

on context) 

z( ) complex low-pass noise function (deterministic or stochastic, depending 
on context) 

A( ) real, nonnegative, low-pass amplitude function (deterministic or stochastic, 
depending on context) 

H( ) Fourier transform of h( ) 


3 



R( ) correlation function 

S( ) Fourier transform of R( ) 

6( ) Dirac delta distribution 

(p( ) real low-pass signal or noise function (deterministic or stochastic, 

depending on context) 

v( ) complex band-pass signal or noise function (deterministic or stochastic, 
depending on context) 

ANALYTIC TIME FUNCTIONS AND STOCHASTIC PROCESSES 
Generalization of the Phasor 

Complex time functions have been used many years in the analysis of linear elec- 
trical systems. Theoretical treatments of lumped electrical networks (refs. 1 and 2), 
modulation techniques (ref. 3), and electromagnetic fields (ref. 4) have been simplified 
by the phasor or rotating vector concept. It is fundamental to the analysis of linear elec- 
trical systems that cause and effect in such systems may be related through linear non- 
homogeneous integrodifferential equations. Where the electrical structure of such sys- 
tems is not time varying, the integrodifferential equations have constant coefficients. 
Where the forcing function is sinusoidal and the solution is bounded (stable system), a 
steady -state solution (particular integral) which is also sinusoidal exists. By making a 
substitution of the form 


A cos(wt + <p) = Re[A exp(j <p) exp(jo>t)J (1) 

for each sinusoid in the integrodifferential equation, the solution, in the steady- state 
case, is reduced to solution of an algebraic equation involving phasors of the form 
A exp(j <p). 

The phasor convention is an aid in obtaining steady- state solutions of sinusoidally 
excited linear time -invariant systems. It has also found application as an aid to visual- 
ization for modulation techniques involving sinusoidal modulating functions. However, 
it is possible to generalize the phasor concept to treat nonsinusoidal time functions. By 
using results from the theory of analytic functions of a complex variable, it is possible 
to consider arbitrary real time functions as the real parts of complex analytic time func- 
tions. This consideration is particularly useful in the analysis of modulation techniques 
and treatment of noise (stochastic) processes. Although it might be possible to construct 
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a means of analysis using complex functions which are not analytic, it will be seen that 
use of analytic time functions provides many advantages. 

Deterministic Functions 

Consider an arbitrary real time function x(t) which is assumed, for the time 
being, to be deterministic; that is, it is assumed that although x(t) is arbitrary, it is a 
member of the class of time functions whose members possess unique and explicit func- 
tion descriptions. Examples of such functions are sin cut, exp(-a;t), and so on. For 
the moment, functions which are members of the class of random functions (sample func- 
tions of stochastic processes) are excluded. Let the complex function related to x(t) 
be defined as 

z(t) = x(t) + jy(t) (2) 

The relationship between y(t) and x(t) must now be determined. Before considering 
y(t), the question of what is meant by z(t) being analytic must be answered. An analytic 
function, in the sense of the theory of complex variables, is a function which satisfies the 
Cauchy-Riemann conditions in some region of a complex plane. Thus to define analytic- 
ity, z(t) must be defined in a complex plane the real axis of which is the t-axis. 

If a function z(t) which is analytic on the real t-axis of a complex plane is given, 
x(t) and y(t) are uniquely related by an integral relation known as the Hilbert 
transform: 

y(t) = dr A x(t) (3) 

where the integral is the Cauchy principal value. This relationship is derived in appen- 
dix A for a suitably restricted class of functions. The properties and behavior of the 
Hilbert transform are interesting and well known. (See refs. 5 and 6.) 

Stochastic Processes 

Consider the case where x(t) represents a real stochastic process which has zero 
mean value and is weakly stationary. An immediate question is, "Can z(t) be defined 
for the stochastic case, as in equation (2), where y(t) is the Hilbert transform of x(t)?" 
The answer is yes. Under certain conditions (refs. 7 and 8), the integral (Hilbert trans- 
form of x(t)) converges in the mean-squared sense, for each value of t, to a random 
variable or to a stochastic process in t. However, it turns out that in the stochastic 
case, only the correlation and spectral properties of x(t), y(t), and z(t) are of interest 
in this paper. Also, for y(t) defined as the Hilbert transform of x(t), it turns out that 
the auto- correlation function of z(t) is an analytic function, as is seen later. Hence, for 
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the purposes of this paper, it is sufficient to define z(t) as "analytic” if its auto- 
correlation function is an analytic function. 


An Analytic Distributional Convolution Transform 

What is desired now is some relatively straightforward method for relating x(t), 
y(t), and z(t) and their correlation functions. There are undoubtedly many approaches, 
each having an appeal depending on the individual reader's background. The following 
method is based on a linear network approach. 


Input 

x(t) 

o 


Output 


J 

h(t) 

z(t) 



i 




Figure 1.- Analytic function generating linear time -invariant network. 

Consider a linear time- invariant network, as shown in figure 1 for which the 
driving function is x(t) and the output is z(t). The function x(t) may represent either 
a deterministic time function or a zero-mean weakly stationary stochastic process. The 
impulse response (weighting) function of the network is h(t). Thus, in the case where 
x(t) is deterministic, z(t) is represented as a linear transformation of the convolution 
type 

p oO 

z(t) = \ x(o) h(t - a) du A x(t)*h(t) (4) 

^ - oo 

which might be defined only as a distribution. In the case where x(t) is stochastic, the 
auto- correlation function of z(t) is (from appendix B) 

Rzz ( T ) = Rxx( r ) *h(r) *h (-t) (5) 

Now, h(t) must be of such a form that both equations (4) and (5) are analytic. 

It will be shown that equations (4) and (5) yield analytic results for h(t) of the 

form 

h(t) = 6(t) + j ^ (6) 

where 6(t) is the Dirac delta functional and is a singular distribution. The quantity 
1/irt may also be viewed as a singular distribution. In fact, in the sense of distribution 
theory, l/irt is the Hilbert transform of 6(t). (See ref. 9.) Thus, h(t) may be said 
to be an analytic singular distribution. 
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Substituting equation (6) into equation (4) gives 





( 7 ) 


which follows by the sifting property of the delta function. The imaginary part of z(t) 
is, by definition, the Hilbert transform of x(t). Thus z(t) is analytic. 

Evaluation of equation (5) for h(t) given by equation (6) is carried out in two parts: 
First, it is shown that 

h(r)*h*(-r) = 2h(r) (8) 

Note that 

h *(- t) = 3(-t) - j ~ = 6 (t) + j = h(T) (9) 


since 6(r) is even. Thus, formally 


h(r)*h*(-T) = J ^5(o) + j -L 


6(t - o) + j 


it(t - cr) 




dc 


h(T).h*(-r) = m Hr - °) dc - £" j. —I— du + J ]■_” i 6(r - o)dc 


> ( 10 ) 


h(T)*h*(-r) = 6(r) + 6 (r) + j[^ + 
h(T)*h*(-T) = 2h(r) 


The convolution operations in equations (10) must be viewed as distributional convolu- 
tions. The convolutions exist in a distributional sense and this result is derived in 
appendix C. Additional reference material on distributional convolution may be found in 
references 10, 11, and 12. 

Secondly, evaluation of equation (5) is simplified by the result of equations (10) as 

Hzz( T ) = Rxx( r ) *21 i(t) (11) 


7 


( 12 ) 


Since Rxx( T ) is deterministic, it follows immediately, as in equation (7), that 

Rzz( T ) = ^|R X x( t ) + jRxx( r )j 

when the Hilbert transform exists. Hence, for the h(t) of equation (6), R^z ( T ) 
analytic and z(t) is an analytic stochastic process. 

Correlation and Spectral Properties 

Since a device in the network of figure 1 for generating analytic functions from 
their real parts has been conceived, the various correlation and spectral relations 
between x(t), y(t), and z(t) may be developed. 

From equation (B23), R^t) may be written as 

R zx (r) = R xx (T)*h(r) = Rxx( T ) + i^xx( T ) (13) 


Also 


Rxz(t) = Rxx(r)*h*(-T) = R xx (t) *h(r) = R^r) 
Thus, from equations (12), (13), and (14) 

l^zx( T ) ; ^xz( r ) = 2 ^zz( r ) 

From equations (B9) 


Rzx( T ) _ Hxx( 1 ") + ]Hyx( T ) 

Rxz( T ) = Hxx( T ) " ]Rxy( T L 
From equations (13), (15), (16), and (B12), the fundamental result follows: 


(14) 


(15) 


(16) 


Ryx( T ) - - ^xy( r ) _ - Ryx( -T ) ~ ^xx( r ) (17) 

The result of equation (17) states that the cross- correlation function Ry X (-r) 
between the imaginary and real part of an analytic process is an odd function and is equal 
identically to the Hilbert transform of the auto- correlation function of the real part. 

This equation is a most useful result, as will be seen in the following sections. 

From equations (B9), Rz Z (t) may be written as 

Rzz( T ) = Hxx( T ) + Hyy( T ) )[%x( T ) ” Hxy( T )j ( 18 ) 

A second fundamental result follows from equations (12) and (18): 
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Hxx( r ) ~ RyyM 


(19) 



I 

I 

I 


The results of equations (12) to (19) have been derived for stochastic x(t). How- 
ever, they obviously hold for deterministic x(t) provided suitable correlation functions 
may be defined, for example, as time averages. Results identical to fundamental 
results (eqs. (17) and (19)) have been derived for deterministic or ergodic x(t) by 
Dugundji (ref. 13) by using time average correlation functions. His results were extended 
to weakly stationary x(t) by Zakai (ref. 14) by using a frequency domain analysis based 
on a defined Fourier operator for the Hilbert transformation. 

By the Wiener-Khintchine relations, the power spectral densities of x(t), y(t), 
and z(t) are Fourier transforms of their respective auto- correlation functions. 

By use of a standard notation employed by Papoulis (ref. 15) and others, the corre- 
spondence between correlation function and power spectral density is denoted as 

Rzz( T ) ■*-*■ ®zz( tL ’) (20) 

It is understood that the Fourier transform may exist in a distributional sense only. For 
functions Rg^r) which possess a Fourier transform in the classical sense (ref. 16) and 
which are convolutions of functions as in equation (11), the transform of the convolution 
is equal to the product of the transforms of the functions being convolved. A similar 
result is also valid for distributional convolution (ref. 10). Thus the spectral density of 
z(t) may be written as 

Szz( w ) = 2S xx (w) H(u>) 

where 

Sxx( w ) ^xx( T )\ 

H(o>) — * h (t) J 


( 21 ) 


( 22 ) 


The Fourier 
distributions 6(t) 


transform of h(-r) is the sum of the transforms of the two singular 
and j — and is given as 

7 TT 


H(oj) = 1 + sgn(w) = 



(a; > 0) 
(w = 0) 
(a> < 0) 


(23) 


Thus 


s zz ( w ) = 


4S xx( w ); 
\ 2S xx (a>); 


0 


f 


(u> > 0)1 

(^ = 0 ) > 

(u> < 0) 

J 


(24) 
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Equations (24) is a third fundamental result. It shows that the spectral density of 
the analytic counterpart of x(t) is just four times the spectral density of x(t) for posi- 
tive frequency and is zero for negative frequency. This result, then, implies the value 
and produces the motivation for use of analytic time functions. Such functions give a tool 
for modeling processes or signals having "one-sided" spectra. It might be suspected 
that such a model is of importance in treating single- sideband transmission systems. 

By similar development, it may be shown that convolving the conjugate analytic 
kernel h*(t) with a real function or process produces the conjugate analytic z * (t) . The 
auto- correlation function for z*(t) is also conjugate analytic. The power spectral 
density is zero for positive frequencies. 

BAND- PASS PROCESSES 

A band-pass process is a process having a spectral density with finite frequency 
domain so that the spectral density does not extend to the origin and becomes zero for 
sufficiently large go. Included in this class of processes are purely stochastic (random) 
processes and also deterministic functions. In communication theory, both signals and 
noise may be modeled as band-pass stochastic processes. Signals may also be modeled 
as band-pass deterministic functions. As in previous sections, the stochastic processes 
are considered to be weakly stationary and of zero mean value. 

The Quadrature Form 

It is usual in dealing with band-pass processes to use a notation which explicitly 
refers the process to some frequency in the neighborhood of the process spectrum. A 
notational form which has been used for some time expresses a band-pass process n(t) 
in terms of two low-pass processes x(t) and y(t), referring to a frequency co c . (See 
refs. 17 and 18.) This notation 

n(t) = x(t) cos co c t - y(t) sin co c t (25) 

is closely related to that of Rice (ref. 19). Equation (25) expresses an amplitude modula- 
tion by x(t) and y(t) on two carriers which are in phase quadrature; hence, the name 
"quadrature form." 

Now, n(t) is, by definition, weakly stationary. Thus, the statistical properties 
of n(t), through the second order, are time-invariant; thus, the two terms in equa- 
tion (25) must be jointly stationary in the wide sense. It is not necessary that they be 
individually stationary since, in fact, they cannot be. That this is true may be demon- 
strated by forming the auto- correlation function of the first component process n^(t): 

nj(t) = x(t) cos co c t (26) 
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This auto- correlation function is 

Riling + t, t) = E^ft + r) n-^t)} 

Rn^nj^ + T >t) = E {x(t + t) cos u> c (t + r) x(t) cos co c t^>l 
Rn^n-^ + T > t ) = | R xx( r ) {c°s w c t + cos u> c (2t + t)J, 


( 27 ) 


Since R^^ft + r,t) is not a function of r alone, it is not time- invariant. Therefore, 
the nj(t) component of n(t) is not weakly stationary. A similar argument holds for 
the other component. 


To find necessary conditions on n(t) so that it is weakly stationary, the auto- 
correlation function is formed: 

Rnnft + T > t ) = E{n(t + r) n(t)} = | e|cos cu c r[x(t + t) x(t) + y(t + r) y(t)] 


+ sin a) c rjx(t + r) y(t) - y(t + t) x(t)J 
+ cos 2o> c t|cos c o c t [x(t + r) x(t) - y(t + t) y(tj] 

- sin co c r[y(t + r) x(t) + x(t + t) y(t)jj 

+ sin 2w c t |sin cj c t [y(t + r) y(t) - x(t + t) x(t)J 

- cos o) c r[y(t + r) x(t) + x(t + t) y(t)]jl 


(28) 


Inspection of equation (28) shows that time invariance of R nn (t + r,t) requires that x(t) 
and y(t) be weakly stationary and that 


Ryy ( T ) = Rxx( T ) 

Ry X (r) = -Rxy(r) = -Ry x (-r) y 


(29) 


Equations (29), the necessary conditions for the quadrature form of a stochastic 
process to be weakly stationary, are satisfied by equations (17) and (19), the fundamental 
results of x(t) + jy (t) being analytic. It is now but a short step to the expression of 
n(t) as the real part of an analytic process ^(t) where 

u(t) = z (t) exp(jco c t) (30) 
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Sufficient conditions for n(t) to be weakly stationary are for z(t) to be analytic. But 
is it necessary for z(t) to be analytic ? The answer is no. Observe that the necessary 
conditions of equations (29) are weaker than those of equations (17) and (19) in that equa- 
tions (29) do not require that Ry X ( T ) be the Hilbert transform of Rxx( T )* Hence ana- 
lyticity is sufficient, but not necessary. 

Equations (29) may be compactly stated as 


E^z(t + t) z(t)^> = 0 


(31) 


which is an auto- correlation type of average obtained without taking the conjugate of z(t). 
Doob (ref. 20) shows that a complex zero-mean Gaussian process also satisfies equa- 
tion (31). Thus, it is possible, in general, to write the analytic expression (eq. (30)) the 
real part of which has the quadrature form and is weakly stationary without z(t) being 
analytic. 


It is now necessary to determine the requirements that must be placed on z(t) so 
that i'(t) will indeed be analytic. The auto- correlation function is developed as 


IW(t + T,t) = E jz(t + t) expjjoj c (t + r)j z *(t) exp(-jo) c tjj 


z(t + r) z*(t) e: 


IW(t + T,t) = E jz 

+ T,t) = Rzz(t) exp(jco c r) 
The spectral density is 


: xp(jw c T)J 


S W M = S zz (o;)*6(ci) - oj c ) 
Syi;(cu) = S zz (C0 - Ci> c ) 


(32) 


(33) 


since the distributional Fourier transform of the exponent function is the delta functional. 
It is known from equation (24) that f(t) being analytic requires that 

S ^(co) =0; (a) < 0) (34) 

Obviously, then 

S zz (oj) =0; (co < -co c ; u(t) analytic) (35) 

The result of equation (35) has been stated by Nuttall (ref. 21). 


The Polar Form 

A notational form which applies equally well to band-pass stochastic processes or 
deterministic functions is the polar form. This form is derived from the most general 

12 



expression for a modulated carrier. Let s(t) be a real process or deterministic func- 
tion of the form of a sinusoidal carrier which is simultaneously modulated in amplitude 
and in phase: 

s(t) = A(t) cos|co c t + 0(t)j (36) 

where A(t) is the amplitude function and <p( t) is the phase function. 

The real s(t) may be written as the real part of an analytic i/(t) as in equa- 
tion (30) where 

z(t) = A(t) exp[j<£(t)) (37) 

In the polar form z(t) is usually termed "modulation function" and is sometimes denoted 
as m(t). 

It is desired that when s(t) represents a stochastic process, it should be weakly 
stationary. The restrictions on the various functions due to stationarity of s(t) are now 
developed. The first-order results are obtained by taking the expected value of s(t): 

E{s(t)} = E {A(t) cos <Mt)} COS <D c t - E{A(t) sin $(t))>sin o> c t (38) 


For equation (38) to be independent of time requires the two expectations to be zero. 
These conditions are satisfied for 

E j-A(t) exp[j0(t)jj = E{z(t)'} = 0 

Thus the first-order requirement is that z(t) have a zero mean value. 


(39) 


The second- order results are obtained from the requirement that the auto- 
correlation function of s(t) should also be invariant with time. Thus, 

“N 

E{s(t + t ) s(t)^> = E |A(t + t) cos[o) c (t + r) + <p(t + r)]A(t) cos|w c t + 0(t)jj 
E^s(t + t) s(t )~y = 1 E |A(t + t) |cos|2u> c t + w c r + $( t + r) + 0(t)J 
+ cos[w c t + ( p(t + r) - 0(t)]J| 

E {s(t + t) s{t)~y = ~ E |A(t + t) A(t) cos|w c t + <p(t + t) - <£(t)jj 


> ( 40 ) 



provided that 


E^A(t + t) A(t) jjcos|j2a; c t + w c r + <p ( t + t) + ^(t)j|^| = 0 


It is easily verified that equation (41) is satisfied if 



t) A(t) expjj|^(t + r) + 0(t)]Jj = E{z(t + r) z(t)} = 0 


Equation (42) is satisfied if c£(t) contains a uniformly distributed constant, 
tions (40) is invariant with time if z(t) is weakly stationary. 


(41) 

(42) 

Then, equa- 


From equation (33), it is seen that when s(t) represents a stochastic signal, its 
sideband structure is determined by the spectral density of z(t). In particular, if z(t) 
is analytic, s(t) is a member of the class of signals having only an upper sideband. If 
z(t) is conjugate, analytic s(t) has only a lower sideband. If either A(t) or 0(t) is 
constant, s(t) is a classic amplitude or angle- modulated carrier. 


When viewed as a signal, u(t) in polar form is generally called an analytic signal 
(see refs. 22 to 24). The various choices for z(t) and the resulting A(t),$(t) to obtain 
hybrid modulations (single- sideband amplitude and angle modulation) have been treated by 
Bedrosian (ref. 24). 


It is seen that by use of the polar form, signals may be treated in the same manner 
as noise; that is, by placing a signal (either deterministic or stochastic) in analytic form, 
all the results obtained for purely stochastic (noise) processes may be applied. Helstrom 
(ref. 25) has made a similar observation. 


CONCLUDING REMARKS 


This paper has presented a set of mathematical tools with which modulated carriers 
and random noise processes may be modeled in essentially the same way. Furthermore, 
both deterministic and stochastic modulation processes are tractable with this notation. 
The notation and concepts presented form a compact basis for treatment of hybrid ampli- 
tude and angle modulation systems. In particular, these tools of analysis are well 
adapted for examination of generalized single -sideband signals in the presence of noise. 

Langley Research Center, 

National Aeronautics and Space Administration, 

Langley Station, Hampton, Va., April 30, 1969, 

125-21-01-02-23. 
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APPENDIX A 


COMPLEX TIME FUNCTIONS AND HILBERT TRANSFORMS 


This appendix is given, for completeness, to show the relationship between Hilbert 
transform and analyticity. Similar treatments have appeared previously. (See ref. 23.) 

Consider a complex time function f(t) given as 

f(t) = u(t) + jv(t) (Al) 

where f(t) is a function of one independent variable, namely t. Then f(t) may be 
described as analytic (on t) if it satisfies the Cauchy- Riemann conditions on the real 
t-axis of a complex plane; that is, if 

z = t + jcr (A2) 

and 


9u(z) _ 9v(z) 
9t “ 9a 


9u(z) _ _ 9y(z) 
9a “ 0t 


(-00 < t < a = 0) 

(-oo < t < oo; a = 0)J 

then f(t) is analytic. When f(t) is analytic, u(t) and v(t) are uniquely related by 

U (t) = l£~ vl 4 dr 
irj_ 00 r-t 

v(t) = _l£~ 

W d_oo T - t 

where the integral is the "Cauchy principal value" given by 

£ " ^ dT - limf r*' £ C“ Jiizi. d,) 

“ -oo ^ °° T ~ t ^t+6 ^ 


(A3) 




(A4) 


(A5) 


The first and second integrals in equations (A4) are known as the inverse and direct 
Hilbert transforms, respectively. 

To derive the Hilbert transform relationships rigorously, and yet in a manner which 
shows the implications of analyticity, requires entry to the complex plane. Consider a 
function f(z) defined on a complex plane and analytic on the real axis and in the upper 
half -plane. By Cauchy T s integral formula, f(z) may be evaluated at any point z = s by 
evaluating a line integral around a suitable contour enclosing s. Let the point z = s lie 
on the real axis at t and the contour be as shown in figure 2. Then f(t) is 



I 


APPENDIX A - Continued 



where T is the closed contour composed of kj, Cj, and C 2 - The contour integral 
about r may now be broken into separate integrals along the paths C 2 , Cj, and kj. 

Let z be defined on C 2 and kj, respectively, as 

z = R exp(j <p); (0 S $ ^ n) (A7a) 

z = t + p exp(j 6); (tt = 9 = 2tt) (A7b) 

In the limit as R becomes arbitrarily large and p approaches zero, T encloses the 
entire upper half-plane, and the integral along Cj approaches the Cauchy principal value. 
By suitably restricting the class of functions f(z), the evaluation of the contour integral 
may be simplified. 


jo 



Figure 2.- Contour for evaluation of f(t). 

The integral about r may be broken up as 

f(t) 'SjI r l^ dZ = Ic l + Ic 2 + Ik 1 <A8) 

where I c , I C2 , and I kl are the limiting case integrals along cj, c 2 , and kj, 
respectively. Let f(z) be restricted so that it is analytic on the T-axis and in the entire 
upper half-plane. Then the integrand has only one simple pole at z = t. Let f(z) be 
further restricted so that 
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APPENDIX A — Continued 


lim I C o = 0 (A9) 

R— 00 

Thus f(z) must be of the class for which ^L. satisfies Jordan's Lemma. Actually, 

Z - t 

these restrictions may be weakened somewhat, but they suffice for the purpose of this 
appendix. The order of the class of functions for which the limit of I C 2 is zero may be 
determined as follows: 


I 


C 2 2ir] 



ft|M 


by the Schwarz inequality. Also, 


(A10) 



(All) 


by the triangle inequalities. Applying the definition of z in equation (A7a) gives 




(A12) 


Suppose now that 


Then 


f(z) = kz a (k, 01 constants) (A13) 


Ic 


< 1 kR a+1 

2 2tt R - 1 1 



k R a+1 
2 R - |t| 


(A14) 


For I C 2 to approach 0 in the limit as R becomes arbitrarily large requires that a 
be negative 

lim I c 2 lim | f-r-T = 0; (a < 0) (A15) 

R— °° * R— °° ^ R - 1 1| 

Thus leg vanishes in the limit if f(z) is of the order of z a for a negative 

Urn Ic 2 = 0 (f(z) = 0(z«); a < 0 ) (A16) 

Next, the evaluation of the integrals along c^,kj may be developed. It is desired that 
the integrals be evaluated in the limit as p approaches zero. It will be shown that in 
the limit, Ikj equals I C j. 



APPENDIX A - Continued 


Since the only singularity in the integrand is the simple pole at z = t, the closed 
line integral about c\, kj, and C£ equals the closed -line integral about kj,k 2 
where k£ is shown dashed in figure 2. This result follows from the residue theorem. 
Thus, abbreviating the integrals yields 



(A17) 


In the limit for R arbitrarily large and p arbitrarily small, 


lim 
R— °° 

P- 0 



(A18) 


lim I 
P—0 



= Um i r 

p— 0 ^k2 z t 


dz 



_ lim JL p f(z)jp exp(j e) 
p- 0 27r i t + p exp(j0) - t 

= lim T f(z)dfl 
p— 0 277 J 0 


de \ 


J 


(A 19) 


by substitution from equation (A7). Because f(z) is continuous and analytic in the 
neighborhood of z = t, the integral in equations (A19) converges uniformly. Thus the 
limit and integral operations may be exchanged. 



But 

lim [f(z)"j = f (t) 
p- 0 L J 

which is independent of 6. Hence, 



Likewise it may be shown that 



(A20) 


(A21) 


(A22) 


(A23) 
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Thus 


APPENDIX A - Concluded 


lim ( C | = lim ( T \ + lim ( T \= f (t) 
R-°°\ J r/ p- 0\ J kiJ p-0\ J k 2 y 


(A24) 


which agrees with equations (A8) and (A17). From equations (A18), (A22), and (A23) it is 
obvious that 

I kl = I Cl (A25) 


as stated, and that 


f(t,= SiI r S i t dz = 2Ici 


(A26) 


Substituting equation (Al) into equations (A26) yields 


u(t) + iv(t) M t > . dr 

T _ t 


(A27) 


Equating the real and imaginary parts of equations (A27) gives the final result 


U ( t ) = i r^-dr ' 

» j.«, T - t 
J_oo T - t 
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APPENDIX B 

CORRELATION PROPERTIES OF COMPLEX STOCHASTIC PROCESSES 

The purpose of this appendix is to derive the properties of, and establish the nota- 
tion for, complex stochastic processes. A stochastic process is defined as a class of 
nondeterministic, or random, time functions. This statement means that an explicit 
defining equation cannot be written for a member function of such a process. Rather, 
such functions and processes can only be described in terms of their statistics. 

Fundamentals 

The notation and outlook of this appendix is essentially that of Papoulis (ref. 15). 
After his procedure, a dual definition shall be employed here so that the equation 

z(t) = x(t) + jy(t) (Bl) 

shall be used to define both a stochastic process and a representative member function 
(sample function) of the process. In general, the result of an operation on a process 
z(t) is stated as some function of z(t). However, the operation itself is defined on a 
member function z(t). Such a duality may appear to be confusing at first, but will, in 
the end, be a most natural way of dealing with stochastic processes. 

In equation (Bl) z(t) is complex, whereas x(t) and y(t) are both real. By 
employing equation (Bl) as a definition of complex processes, the operations on z(t) 
may be reduced to operations on real processes. Thus, the large body of knowledge 
which applies to real stochastic processes may also be applied to complex processes. 
However, certain results for real processes are more easily derived by considering com- 
plex processes. This appendix assumes knowledge of probability theory for real stochas- 
tic processes. What is presented here is the extension to complex processes. 

The properties of interest, to be derived here, are the statistical mean and statisti- 
cal cross-correlation functions. These properties are average properties, as might be 
expected, since it is generally not possible to discuss instantaneous properties of random 
processes. Initial consideration may be limited to these two average properties. From 
these two, others may be derived. 

The mean, or expected, value of a complex stochastic process z(t) denoted 7 j z (t) 
is defined as 

77 z (t) = E{z(t)} (B2) 

where E<(^ denotes a statistical averaging process known as the "expectation." The 
expectation or expected value of a random variable x is defined as 


k 
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J OO 

^xp x (x) dx (B3) 

where P x (x) is the probability density function of x, the derivative of the distribution 
function P x (x). For continuous P x (x), equation (B3) may be defined as a Riemann inte- 
gral. Where the random variable x is of the discrete type, p x (x) may be defined by 
using delta functions (Dirac) and equation (B3) defined as a distributional integral. (See 
appendix C.) 

The cross-correlation function, defined for pairs of complex processes w(t) and 
z(t), denoted R^^t + r,t) is 

Rw Z (t + T,t) = E{w(t + t) z*(tj) (B4) 

where the superscript asterisk denotes a complex conjugate. The symbol r denotes a 
displacement in time between the two functions whose product is being averaged. In 
general, the auto- correlation function is dependent on both t and r. 

It is shown by Papoulis (ref. 15) and others that the expectation e{^^> is a linear 
transformation. That is, 

E (aX + by} = aE {x} + bE {V} (B5) 

where a and b are scalars and X and Y are random variables. The domain of 
e{> is a space of random variables. In general, the range is a space of functions of 
one or more independent variables. 

The cross-covariance function C wz (t + r,t) is defined in terms of equations (B2) 
and (B4) as 

c wz (t + r,t) = R^ z (t + r,t) - 7? w (t + t) 77 z *(t) (B6) 


For the case where w(t) and z(t) are identical, equations (B4) and (B6) specialize to 
the following auto- correlation and auto- covariance functions, respectively: 


R zz (t + T »t) = E { z (t + T ) z*(tj} 


C zz (t + r,t) = Rz Z (t + r,t) - rj z (t + r) rj z *(t)| 


(B7) 


Suppose w(t) is a complex stochastic process given by 

w(t) = u(t) + jv(t) 


(B8) 


Expanding equation (B4) into its components in regular and reverse order, where u(t) 
and v(t) are real stochastic processes, gives 
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+ T >^) ~ ^ux(^ + + Ryy(t + T,t) + j|R vx (t + T,t) - Rjjy (t + T,t)j 

t + t) = RxuC^ + r 9 t) + Ryy(t + T,t) + jjRxvft + T >t) " Ryu(t + T >t)j 
Rzw^ + ’ r >^) = Rxu^ + Byy(t + T >^) _ J^xvCt + 0 “ Ryu(t + 

RzW^> t + t) = Rux(t + Tjt) + Ryy (t + T,t) - ]|RvxO- + T jt) - Ruy (t + r,t)] 


(B9) 


By a suitable change of coordinates in the defining equations, it may be determined that 
the following general relation exists: 

C wz (t + Tjt) = C zw (t, t + t) = C zw (t - T,t) (BIO) 


Equation (BIO) is a very general relation from which several specializations may 
be made. It follows that for complex z(t) and w(t), 


RwzO- + T >t) — RzwO' “ T >^) 
Rzz(t + T,t) = R* z (t - T,t) 


(Bll) 


For real processes, for example, p(t) and q(t), 


Rpq(t + T,t) = Rqp(t - r,t) 
Rpp(t + T,t) = Rpp(t - T,t) 


(B12) 


A stochastic process is defined as stationary in the strict sense, if all its statistical 
properties are invariant with time. Thus, for a strict sense stationary process 

Rwz(t + T »t) = R\vz( T ) (B13) 

Independence of time t of the mean and auto- correlation function are not sufficient to 
insure strict sense stationarity. A process with this more restricted form of stationarity 
is defined as weakly stationary, or stationary in the wide sense. It should be noted in 
passing that when a process is composed of the sum of two component processes, it may 
be possible that the sum is weakly stationary but neither component is weakly stationary. 
For example, see equation (27). 

Linearly Transformed Processes 

The relationships for the case where z(t) is a linear time -invariant transforma- 
tion of w(t) are now considered; that is 

z(t) = f[w(t)] (B14) 
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where 

f[aj wj(t) + a 2 w 2 (t)] = aj f[wj(t)] + a 2 fjw 2 (t)] 

and 

z(t + r) = f|w(t + t)J 


(B15) 

(B16) 


Equation (B15) expresses the linear property of the transformation f, whereas equa- 
tion (B16) expresses the time invariance. 

Consideration is limited to transformations of the convolution type where z(t) may 
be expressed in the form 


r\ OO 

z(t) A w(t)*h(t) = \ w(t - a) h(a) da 

^ - OO 


(B17) 


where h(t) is some weighting function. Papoulis (ref. 15) and others have shown that if 
w(t) is weakly stationary, then z(t) is also. Furthermore, the expectation transforma- 
tion e{[^} may be manipulated so that the mean of z(t) and the various correlation 
functions are easily obtained. 

For w(t) weakly stationary, the mean is given as 


V z = E{z(tf}> = E< \ w(t - a) h(a) da) 


>} 


(B18) 


By a theorem of Papoulis (ref. 15), the expectation and integration operations may be 
taken in reverse order. Then, 


V 


z 



E {w(t - o)}>h(a) da » r? w *h(t) 


(B19) 


If w(t) (and, hence, z(t)) is weakly stationary, the various correlation functions are 
obtained as follows. First, the cross-correlation function R 2 W (t) is obtained: 


Rzw(t) = E{z(t + t) w*(t)} = E {z(t) w*(t - t)} 
H zw (r) = E^w*(t - t) J w(t - a) h(a) da| 

Rz W (r) = e/C °° w(t - a) w*(t - t) h(a) da 


•} 


(B20) 


Exchanging order of integration and expectation, as was done for the mean, gives 

Rz W ( T ) = f E{w(t - a) w*(t - t)} h(a) da (B21) 
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But 


Thus 


But 


Thus 


E {w(t - a) w*(t - t)} = R wnyCr - a) 

/"» oo 

Rzw( r ) = \ ^ww^ T “ °) M°) do* = Rww( T )*h( T ) 

^ - oo 

Next the auto- correlation function ;z (r) is obtained: 

Rzz( T ) = E { z (* + T ) z*(t)} 

R zz (r) = E jz(t + r) J w*(t - a) h*(a) daj 

Rz Z (t) = E^J z(t + r) w*(t - a) h*(a) daj 

Rzz( T ) = J E{z(t + t) w*(t - a)}h*(a) da 

E{z(t + r) w*(t - (fjy = R2 W (a + r) 




RzzW = f *W( a + r) h*(a) da = f (r - a) h*(-°) da 

^ - oo oo 

Rzz(t) = Rzw(T)*h*(-r) 


(B22) 

(B23) 


(B24) 


(B25) 


(B26) 


Then, from equation (B23) 

Rzz( T ) = [Bww( T )*MT)]*h*(-T) (B27) 

The brackets in equation (B27) may be dropped if the order of convolution is understood to 
be that of equations (B26) to give 

RzzM = *W T )*h (r) *h*(-r) (B28) 

Where the convolution of equation (B27) exists as a Riemann integral, the operation 
is both associative and commutative. Hence, the order is not important. However, for 
certain pathological functions (irregular distributions) where the convolution integral may 
exist only in a distributional sense, associativity may not apply and the order of convolu- 
tion may become important. 
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APPENDIX C 


RESULTS FROM DISTRIBUTION THEORY 

The purpose of this appendix is to give a rigorous proof of equations (10). Such a 
proof must necessarily use techniques and results from the theory of distributions. (See 
refs. 10 to 12.) A working knowledge of the theory is assumed. Only the notation and 
two special lemmas are given here, prior to proof. 

The reader should note that this proof contains within it the justification for the 
statement that "In the sense of distribution theory, l/fl-t is the Hilbert transform of 
the Dirac delta distribution 6(t)." 

Definition 1: Let D denote the space of testing functions <p(t) (ref. 12, p. 2). 

Definition 2: Let D' denote the space of (distributions) continuous linear functionals 

f(t) over D (ref. 12, p. 7). 

Definition 3: Let S denote the space of testing functions <£(t) of rapid descent 
(ref. 12, p. 100). 

Definition 4: Let S' denote the space of (distributions of slow growth) continuous 
linear functionals f(t) over S (ref. 12, p. 102). 

Definition5: Let denote the scalar which a distribution f(t) associates 

with a testing function 0(t) (ref. 12, p. 7). 

Definition 6: Let f(t)*g(t) denote the distributional convolution of the distributions 

f(t),g(t) (ref. 12, p. 124). 

Definition 7: Let f(t) C S',<£(t) CS. Let <$(cd) denote the Fourier transform of 4>(t). 

Then, the distributional Fourier transform F(o>) of f(t) is defined by the rela- 
tion (ref. 12, p. 184; ref. 10, p. 64): 

<F(w),S(w)> = <f(t),27r<M-t)> 

Definition8: Let f(t) C S'. For p a natural number, f(t) is said to be a member of 

the space Lp if and only if: 

£(t) ' I 

for some natural numbers M and r m ; and, for each f m (t) C Lp, 

J oo l f m( t )| Pdt < 00 


(See ref. 10, p. 163.) 
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Lemma 1: For 1 ^ p,q § 2, let fj(t) C Lp and f 2 (t) C Lq. Let Fi(o>) and F 2 (o>) 
be the distributional Fourier transforms of f^(t) and f 2 (t), respectively. Then, 
the distributional Fourier transform of f^(t)*f 2 (t) is Fj(w) F 2 (w). (See ref. 10, 
p. 167.) 

Lemma 2: For p a natural number such that p > 1, C Lp. (See ref. 10, p. 171.) 
Theorem : Let h(t) denote the distribution given by 

h(t) = 6(t) + j 1 

where 6(t) is the Dirac delta distribution. Then 

h(t)*h*(-t) = 2h(t) 

Proof: It is seen that 

h*(-t) = e(-t) - i ^ = 5<t) + i £ = h(t) 

since 6(t) is even. Hence, 

h(t)*h*(-t) = [o(t) + j i]*[6(t) + j i] 

h(t)*h*(-t) = 5(t) + 2j i i i 

by the sifting property of 6(t). For p > 1, \ £ Ln, by lemma 2. Hence, 

7rt ^ 

{it* tv Wt> ) = h ( sgn2(u,) ' 

Thus, 

h(t)*h*(-t) = 6(t) + 2j 1 + 6(t) 

7Tt 

h(t)*h*(-t) = 2[fi(t) + j 
h(t)*h*(-t) = 2h(t) 
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